Synchronization of Non-Linear Random Walk Dynamics in Complex Networks 
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This work addresses synchronization in transient, non-linear stochastic dynamics corresponding 
to accesses performed by self-avoiding walks originating at each node of a complex network. More 
specifically, the synchronizability of accesses incoming from other nodes has been considered and 
quantified in terms of the entropy of the mean periods of access, being closely associated to the 
efficiency of access delivery to each node. The concept of synchronous support of a node i has also 
been suggested as corresponding to the nodes which contribute the most for the synchronization 
of the accesses to i. These concepts have been applied to the analysis of 6 networks of different 
types, leading to markedly smaller synchronizability being obtained for the Watts-Strogatz and a 
geographical models. The more uniform synchronizabilities were identified for the Watts-Strogatz 
and path-regular structures. Varying degrees of correlations were found between the synchronizabil- 
ity and the degree or outward accessibility of the nodes. The synchronous support of a node i has 
been found to present diverse structure, including nodes which may be near to i, or nodes which 
are scattered through the network and far away from i. 



PACS numbers: 05.10.-a, 05.40Fb, 89.70.Hj, 
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'That which is static and repetitive is boring. That 
which is dynamic and random is confusing. In between 
lies art.' (J. A. Locke) 



I. INTRODUCTION 

One special kind of dynamics regards the synchroniza- 
tion of events, manifesting itself in many natural sys- 
tems such as brain activity, heart cell oscillations, and 
animal movement and development. Synchronization is 
also closely related to the efficiency of several types of 
dynamics. For instance, the uniform rate at which com- 
ponents arrive at a factory is essential for avoiding delays 
or accumulation of parts, the rate in which molecules are 
produced and transformed into other molecules and tis- 
sues are critical for life, among other possibilities. There- 
fore, it is hardly surprising that growing attention has 
been focused on the study of synchronization in complex 
networks (e.g. [H, i, i, [i, ^, _6,'7, 8, 9, 10, 11, 12]). How- 
ever, the majority of such investigations have addressed 
synchronization of linear dynamics. 

The current work addresses the stochastic synchro- 
nization in transient non-linear dynamics defined by self- 
avoiding random walks (the extension to other types of 
walks is immediate). We start by estimating the tran- 
sition probabilities of agents moving into a node after 
having initiated random walks at the other nodes h steps 
before. Several types of mean frequency and period of 
accesses are defined, and the synchronizability is defined 
in terms of the normalized entropy of the mean period of 
accesses to each node i by moving agents which initiated 
their walks at any of the H previous steps. The concept 
of synchronous support of each node i is introduced, cor- 
responding to the set of nodes which contribute the most 
to the synchronizability of i. The potential of these con- 



cepts and methods for characterization of the transient, 
non-linear dynamics in complex networks is illustrated 
with respect to 6 networks of different types, leading to a 
series of interesting results regarding not only the intrin- 
sic overall synchronazibility of each type of network, but 
also concerning correlations between synchronizability 
and degree or outward accessibility. Of particular inter- 
est has been the identification of substantially lower syn- 
chronizabilities for the Watts-Strogatz and path-regular 
models and the possibility of relatively accurate estima- 
tion of the synchronizability of nodes in ER networks 
from the respective degree. 

This article starts by summarizing the main concepts 
in complex networks and random walks and proceeds 
by defining synchronizability and synchronous support. 
These concepts are then applied for the characterization 
of transient non-linear dynamics in 6 networks of distinct 
kinds. 



II. BASIC CONCEPTS 

This section summarizes the main concepts in network 
representation, measurement, random walks, as well as 
the six network models assumed in the present article. 



A. Complex Networks Basics and Models 

A directed and weighted network F can be represented 
in terms of its weight matrix W, so that each connection 
with weight r from node i to j, i,j G {1, 2, . . . , N} and 
i ^ j, implies W{j, i) — r. Observe that these weighs can 
correspond to probabilities in some cases. The absence 
of a connection between those nodes is represented as 
W{j, i) = 0. W becomes symmetric in the case of undi- 
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rected networks. The topology of F can be represented in 
terms of the respective adjacency matrix K, obtained as 
K{i,j) = 6{W{i, where S{a,b) is the Kronecker's 

delta. Observe that K is a binary matrix. The instrength 
of a node i is given by adding the weights of all the re- 
spective incoming edges (an analogue definition holds for 
the outstrength) . The indegree of a node i in K is the 
number of incoming edges (similar for the outdegree) . If 
K is symmetric, indegree = outdegree = degree. 

The immediate neighbors of a node i are those nodes 
which can be reached from i through a single edge. A 
walk can be defined as a sequence of adjacent edges. A 
path is a walk which never repeats an edge or node. The 
length of a walk (or path) is equal to the number of edges 
along it. A random walk is defined by a moving agent 
as it performs a walk along the network. A emphself- 
avoiding random walk or path- walk is defined by a moving 
agent as it performs a walk without repeating nodes or 
edges. 

Six models of complex networks are considered in 
the present article: Erdos-Renyi (ER), Barabasi- Albert 
(BA), Watts-Strogatz (WS), a geographical model (GG), 
as well as two knitted networks (PN and PA) 
EES El- The ER network (see also ^) is obtained 
by establishing connections between pairs of nodes with 
fixed probability The traditional preferential attachment 
rule (e.g. [H, [13, [l^, [l^) is used here in order to ob- 
tain BA networks. The geographical network adopted in 
this article is obtained by distributing N nodes along a 
two-dimensional space and connecting every pair of node 
whose nodes are closer than a given threshold. Path- 
regular network (PN) can be obtained by performing 
several path- walks along the N nodes [3, [3 1 ^^'^ 
path-transformed BA networks are obtained by convert- 
ing a BA networks through the star-path transformation 
of network connectivity [Oillll- Therefore, this type of 
network includes paths with several lengths (power law) . 
All networks considered in this work, except the virtual 
networks established by the transition probabilities, are 
undirected and have similar node degree (fc) w 6 and 
number of nodes N. Only the largest connected compo- 
nent, which contains most nodes because of the relatively 
high adopted value of (fc), of each networks is used herein. 



B. Synchronization in Random Walk Models 

Let F be a complex network in which moving agents 
perform self-avoiding walks after having started at a spe- 
cific node. Let the transition probabilities of the mov- 
ing agent from node i to node j after h steps along its 
self-avoiding walk to be Ph{i,j)- Observe that, except 
for h — 1, non-zero values of Ph(i,j) do not necessar- 
ily means the presence of a physical edge extending from 
node i to j, being here understood as virtual edges cite- 
Costa:2004. The set of nodes j which connect to node i 
through paths of length h are henceforth represented as 
$;i(i). Observe that such a formulation can be immedi- 



ately extended to other types of Markovian walks. The 
transition probabilities Ph{i,j) can be estimated compu- 
tationally by performing several walks of length H start- 
ing at all the network nodes and accumulating the num- 
ber of visits to each node (the probabilities are estimated 
by the relative frequencies). Figure [^b) illustrates the 
probabilities ^2(9, 5) considering the simple network in 
(a), q e $2(5) = {1,4,6,8}. The nodes in gray corre- 
spond to the nodes in $2(8). Having started the walk at 
node 1, the moving agent has probability Pi (a, 2) = 1/2 
of going to node 2 and then Pi (2, 5) = 1/3 of reaching 
node 5. As this is the only path from 1 to 5, we have 
P2(l,5) = Pi(l,2)Pi(2,5) = 1/6 because of the Marko- 
vianity of such a dynamic stochastic system. 




FIG. 1: A simple network containing N = 7 nodes and the 
respective transition probabilities P2(g, 5), with q G $2(5) = 
{1,4,6,8}. 



Observe that the transition probability matrix P^ 
can be understood as the transpose of a weight ma- 
trix describing virtual edges between the original nodes. 
After estimating Ph{i,j) for i,j g {1, 2, . . . , A^}, it 
becomes possible to define the accessibility to each 
node [2l[ . The inward accessibility of a node i af- 
ter h steps has been understood [21[ as being equal 
to IAh{i) = J2y=iPh{v,i)/{N - 1). The outward ac- 
cessibility of node i after h steps has been defined as 
OAh{i) = exp{Eh(i)) / {N - 1), where E{h{i) is the 
diversity entropy |2ll | of node i, given as Eh{i) — 
-j:t,PHit,v)log{Ph{t,v)). 

It is assumed henceforth that self-avoiding walks are 
initiated from all nodes at each time step. The mean 
frequency of accesses to node i received from node j after 
h steps is immediately given as fh{j,i) = Ph{i,i)- The 
respective mean period of accesses is Th{j,i) = l//h(j, i). 
Observe that Th{i, j) G {1, 2, . . . , A'' — 1} for any i and 
j. Table |T] includes other important mean frequencies 
of accesses. Observe that the respective mean periods 
of accesses can be immediately obtained by taking the 
reciprocal of the respective mean frequencies. 

It can be easily shown that 1 < T{i) < N - 1. The 
probability that all the moving agents which started their 
walks at the nodes in $?i(i) reach node i after h steps is 
given as Sh{i) = Hve-P^ii) Phiv,i)- Consequently, the 
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Mean frequency of accesses to node j 
by moving agents which, h steps ago, 
left from node i: 


fh{i,j) = PhiiJ) 


Mean frequency of accesses to node i 
by moving agents which, h steps ago, 
left from all other nodes: 




Mean frequency of accesses to node j 
by moving agents which, from 1 to H steps ago, 
left from node i: 




Mean frequency of accesses to node i 
by moving agents which, from 1 to H steps ago, 
left from all other nodes: 


m = ELi Ell PniiJ) = Ell fM 



TABLE I: The definition of the several mean frequency of accesses by moving agents. 



maximal surge of accesses to a node i by nodes which 
started their walks at h steps before will occur with pe- 
riod = \/Sh{i)- The sm'ge frequency considering 
all time steps is Sh{i) = I]f=i D^e^ji) Ph{v, i)- 

Figure [2] illustrates the above concepts with respect to 
the network in Figure [TJ In Fig. [21^ a) are shown the visits 
to node 5 along the time t received by moving agents 
which started their walks at nodes 1, 4, 6 and 8 (each 
line of the diagram). Figure [DJb) illustrates the total of 
number of received visits at each time t by agents which 
started their walks h = 2 steps before. For this case, we 
have that /2(1,5) = 1/6, /2(4,5) = 5/12, h{6,5) = 1/3, 
/2(8,5) = l/4, and/2W = 7/6. 
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40 80 (b) 120 160 200 

FIG. 2: The accesses to node 5 along time t by agents which 
left nodes 1, 4, 6 and 8 h = 2 steps before (a), and the respec- 
tive total of such moving agents arriving at node 5 at each 
time t. 



Though the agents arriving at node 5 after 2 steps 
from the start of their respective walks at the nodes 
V G 3*2(5) will present a well-defined mean frequency of 
arrivals f2{v, 5), because of the statistical fluctuations it 



makes little sense speaking of phase or phase synchroniza- 
tion between such time series. Still, we consider in this 
work the synchronization between the agents arriving at 
a node i in terms of the similarity between their mean fre- 
quencies of arrival at j. In order to do so, let us assume 
that each node i needs to receive one visit from each 
of all other nodes (the involving subset of these nodes 
are immediate) before being able to treat them (e.g. to 
produce a respective molecule of perform some compu- 
tation). Let us also suppose that, having received such 
visits, node i takes a period of time T{i) to process them. 
The ideal situation regarding the processing speed and 
occupation of node i takes place if and only T(i) — T(i). 
Such a matching of frequencies is what we understand by 
synchronization in the present work. It becomes interest- 
ing to devise an objective quantification of the frequency 
synchronizability of each node in the network. 

In this work, the synchronizability is simply expressed 
in terms of the normalized entropy of the effective periods 
of accesses to each node per unit of time T{i), i.e. 



N 



e{i) = -^p{T{v,i)log{p{T{v,i))) 



(1) 



logjN - 1) - ejt) 

= Miv-1) 

where T{v,i) ~ l/f{v,i) (see Table |l|, e{i) is the en- 
tropy of T(v, i) and log[N — 1) is the maximum entropy 
possibly achieved in any network. It can be verified that 
< a{i) < 1. Thus, in case a node i receives accesses 
with identical frequencies F(i), we will have cr{i) = 1, 
indicating maximum synchronizability. The synchroniz- 
ability of node i, and therefore the efficiency in the use of 
the access received at that node, will decrease when the 
probabilities p{T{i)) tend to concentrate on a few nodes. 
Figure [3] illustrates that when a node i (in this case, 
node 2) has imediate neighbors with different degrees, 
different rates of accesses to node i (i.e. Pi (2, 1) = 1/3, 
Pi(3, 1) = 1 andFi(4, 1) = 1/5 ) will be obtained, im- 
plying high entropy of mean periods of accesses to i. In 
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networks where a node with high degree has an inherent 
change of being attached to nodes with diverse degrees, 
a negative correlation between the synchronizabihty and 
the node degree is expected. Such a relationship, how- 
ever, is not guaranteed because the synchronizabihty in- 
volves more global connectivity around each node. 




FIG. 3: A simple situation illustrating how the entropy of 
mean periods of accesses to a node (1) increases when the 
immediate neighbors of that node have different degrees. 



It is also interesting to identify for each node i what 
are the other nodes in the network which contribute the 
most for the synchronization of accesses to i. This can 
be done by identifying the highest value of p{T{v,i)), 
henceforth represented as Pmaxii), and finding out which 
nodes s have T(s,i) nearly equal to the respective mean 
period. Such more highly synchronized nodes are hence- 
forth called the synchronous support of node i, henceforth 
represented as S{i). Finally, observe that the probabili- 
ties p{T{v, i)) can be easily estimated from the histogram 
of relative frequencies of T(i), derived from the transition 
matrices Ph- 



III. RESULTS AND DISCUSSION 

In order to illustrate the concepts described in this ar- 
ticle, we considered 6 theoretical complex networks mod- 
els — namely Erdos-Renyi (ER), Barabasi- Albert (BA), 
Watts-Strogatz (WS), a geographical model (GG) as well 
as two knitted networks (PN and PA), all with N = 100 
(except GG, for which N = 91) and (k) « 6. In all cases, 
a total of 2000 self-avoiding walks were initiated at each 
of the nodes in order to estimate the transition probabil- 
ities Ph{i,j) for all nodes and for h ^ 1 to H = 10. 

Figure 3] shows the histograms of synchronizabilities 
obtained considering each nodes for each network and 
H = 10 (the mean and standard deviations of the syn- 
chronizabilities are shown in the respective titles). The 
ER, BA, PN and PA networks yielded similar and rela- 
tively high synchronizatbilities, while the WS and GG 
were characterized by substantially lower values (see 
Figs.HI^c) and (d)). The smallest dispersions of synchro- 
nizabihty were obtained for WS and PN. Additional ex- 
periments performed indicated that the mean synchroniz- 
abihty tends to decrease substantially with smaller values 
ofH. 

Figure \5\ shows the scatterplots of the synchronizabil- 
ities fj of each node against its respective degree k. The 



Pearson correlation coefficients are shown in the title of 
each plot. Such results show that the correlations be- 
tween a and k vary markedly for each type of network. 
ER showed the highest correlation, suggesting that the 
synchronizabihty of its nodes can be reasonably predicted 
from the respective degree. In the case of the BA struc- 
ture, cr exhibited an almost quadratic increase with fc, 
also leading to a well-defined relationship between these 
two features. Moderate positive correlations were also 
found for the PN and PA network. However, small cor- 
relations were obtained for the WS and GG structures, 
with negative weak correlation being observed for the 
WS network. This implies that it is virtually to infer the 
synchronizabihty of a node in the GG structure from its 
degree. 

Figure [6] shows the geographical network considered 
in this article, with the synchronizabilities of each node 
identified by the color legend. Node 90 presented the 
highest synchronizabihty value ((t(90) = 0.45). Observe 
that the values of a tend to be similar among neigh- 
boring nodes (assortativeness of synchronizabihty) . The 
more central nodes, identified by larger outward accessi- 
bility, resulted with the lowest synchronizabilities. Also, 
the more isolated group of nodes at the upper left-hand 
side of the figure presented the highest values of synchro- 
nizabihty. Because such nodes are known [2l| to have 
low outward accessibility OA, it is interesting to consider 
possible correlations between this measurement and syn- 
chronizabihty. 

Figure [7] shows the scatterplots obtained considering 
the synchronizabilities and outward accessibilities (cor- 
responding to the mean value of the accessibilities along 
the H steps) of each node for all the networks in this ar- 
ticle. The Pearson correlation coefficients are also shown 
respectively to each plot. The results show that varying 
correlations are verified between a and OA for each type 
of network The ER and PA structures showed particu- 
larly strong positive correlations (Fig. [7^ and f), while the 
WS model exhibited the weakest correlation (Fig.[7l:). In- 
terestingly, the synchronizabihty resulted negatively cor- 
related for the GG network (Fig.[7ti). 

The nodes belonging to the synchronous support of 
node 50, which has an intermediate synchronizabihty of 
tT(50) = 0.26, are shown in Figure [S] with wider bor- 
ders. The respective histogram of relative frequencies 
of mean periods of accesses to this node, i.e. T{v,50), 
V = 1,2,. ..,iV, is depicted in Figure [51 Observe that 
the synchronous support of node 50 comprises most of 
the nodes in the small community to which it belongs, 
except only for nodes 22, 24 and 25. Similar relationship 
with communities has been verified for nodes 61 and 52. 
However, the synchronous support of node 1 was found 
to include nodes 2, 15, 25, 36, 48, 63 and 71, which are all 
far away and scattered through the right-had side of the 
network. This suggests that the synchronous supports of 
nodes in a GG network do not seem to follow a typical 
structural pattern. 
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FIG. 4: Histograms of the synchronizability obtained for each of the 6 networks. 



IV. CONCLUDING REMARKS 



Wc have considered the situation where, after leaving 
continuously from each of the nodes in a complex net- 
works, moving agents perform self-avoiding walks of fixed 
and finite length along complex networks. After estimat- 
ing the probabilities of accesses received by each node by 
agents leaving from each of the other nodes a number 
of steps behind, it is possible to consider synchroniza- 
tion between the respective mean frequencies. An objec- 
tive measurement of the synchronizability of each node 
has been reported which takes into account the entropies 
of the mean periods of accesses from all other nodes by 
moving agents which initiated their walks at any of the 
H previous steps. It has been shown that such a kind 
of synchronization optimizes the deliver to the reference 
node of agents originating at each of the other nodes at 
a constant rate and well-defined, avoiding accumulation 
or lack of accesses along the critical period. Such a result 
also allows the identification of optimal processing times 
for each node. Modifications of the reported framework 
to consider different rates of random walks emanating 
from each node or accesses from subsets of the network 
nodes, instead of from all nodes, are straightforward and 
can be useful for more general applications. The concept 
of synchronous support of a node has also been suggested 



in order to identify the nodes which most contribute to 
the synchronizability of each node. Several interesting 
results have been obtained, including the identification 
of distinct overall synchronizability exhibited among 6 
types of networks (with the WS and GG being less syn- 
chronizable) , as well as the identification, in the case of 
the GG, of assortativeness of synchronizability and the 
fact that the synchronous support of the nodes tend not 
to exhibit a typical pattern. The correlations between 
the synchronizability and degree or outward accessibility 
have also been considered and found to present diverse 
patterns. For instance, while the synchronizability of the 
nodes in an ER structure can be reasonably inferred from 
their respective nodes with relatively high accuracy, it is 
virtually impossible to perform such predictions in the 
case of the GG structure. Therefore, interesting patterns 
of relationships have been identified between a topologi- 
cal feature (node degree) and the dynamic property of 
synchronizability in the transient non-linear dynamics 
defined by self- avoiding random walks. 

Future developments include the search for additional 

possible topological features which can explain or pre- 
dict synchronizability, studies of scaling with the average 
degree and network size, and the investigation of syn- 
chronizabilities implied by different types of walks. Also 
interesting would be to search further for possible rela- 
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FIG. 5: Scatterplots of synchronizability against the node degree for the six considered networks. 



tionships between the synchronizability and community 
structure. In addition, the concepts described in this ar- 
ticle have good potential for applications in real-world 
problems, including biological systems, transportation 
and communications networks. Of special interest is the 
study of non-linear transient sychronizability in neuronal 
or cortical networks, especially by considering frontwave 
random walks, i.e. the progression of accesses along the 



successive neighborhoods of each node (e.g. [2^). 
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FIG. 7: Scatterplots of the synchronizability a against the respective node degrees k obtained for each of the 6 networks. 



Histogram of mean periods of accesses to node 50 
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FIG. 8: Histogram of the relative frequencies of mean periods 
of accesses to node 50 from all other nodes in the network. 



